Informe Final PinkFairness

1. Motivación

En esta sección se hace la descripción del caso de uso indicando el problema o tarea específica que se soluciona, proporcionando una visión general del mismo. Asimismo, se establece las necesidades y requisitos específicos del proyecto.

Requisito Descripcion
target_population La población objetivo está compuesta por personas que han sido arrestadas en el condado de Broward, Florida, y cuyos perfiles fueron evaluados mediante el sistema COMPAS para predecir su probabilidad de reincidencia. La solución impacta principalmente a:\nPersonas privadas de la libertad y en proceso judicial.\nFuncionarios judiciales que toman decisiones de libertad condicional o fianza.\nComunidades vulnerables, especialmente aquellas sobre-representadas en el sistema penal (ej. personas afroamericanas).
context El objetivo del sistema es predecir la probabilidad de reincidencia criminal de una persona en un periodo de dos años, para apoyar la toma de decisiones judiciales como libertad condicional, asignación de recursos de rehabilitación o severidad de las penas. Las metas principales son:\nEvaluar el riesgo de reincidencia de forma automatizada.\nEstablecer perfiles de riesgo que contribuyan a decisiones más informadas.\nMejorar la eficiencia del sistema judicial penal.
sensitive_data En el análisis con enfoque de equidad se reconoce que variables como raza y género son atributos sensibles. El manejo adecuado implica:\nEvaluar el impacto de estos atributos en las decisiones del modelo.\nDocumentar y monitorear continuamente los resultados para evitar discriminación sistemática.
limitations Representatividad limitada: los datos provienen únicamente del condado de Broward, Florida, lo que impide su generalización a otras jurisdicciones.\nPosibles sesgos históricos: los registros reflejan decisiones humanas pasadas, que pueden estar sesgadas.\nTransparencia del algoritmo: el sistema COMPAS es propietario, lo que impide conocer todos los detalles de su funcionamiento interno.\nTiempo de validez: los datos corresponden a un periodo determinado, lo que puede generar desactualización.
benefits Mejora en la toma de decisiones judiciales si se garantiza equidad y precisión.\nReducción del hacinamiento carcelario si se identifican correctamente personas de bajo riesgo.\nDisminución de reincidencia al identificar casos que requieren intervención o seguimiento.
ethics Uso correcto: una aplicación justa del modelo puede mejorar la eficiencia judicial y proteger los derechos individuales.\nUso malintencionado o negligente:\nDiscriminación sistemática hacia grupos históricamente marginados (por ejemplo, afroamericanos).\nPerpetuación de sesgos institucionales al no intervenir adecuadamente en los datos de entrenamiento.
maintenance Se recomienda un monitoreo semestral para:\nAccuracy: Proporción de predicciones correctas sobre el total de casos. Mide el rendimiento general del modelo.\nRecall (Sensibilidad o Tasa de verdaderos positivos): Mide cuántos de los casos realmente positivos (reincidentes) fueron correctamente identificados por el modelo. Es especialmente importante si se quiere evitar liberar a una persona que sí reincide.\nF1-score: Media armónica entre precisión y recall. Es útil cuando existe un desbalance de clases (por ejemplo, si hay menos reincidentes que no reincidentes) y se busca un equilibrio entre falsos positivos y falsos negativos.\nDisparate Impact: Relación entre las tasas de resultados favorables entre un grupo protegido (por ejemplo, personas negras) y un grupo privilegiado (por ejemplo, personas blancas). Un valor cercano a 1 indica paridad, valores inferiores a 0.8 pueden indicar discriminación según criterios legales.\nEqual Opportunity Difference: Diferencia en las tasas de verdaderos positivos entre grupos. Evalúa si el modelo otorga las mismas oportunidades de recibir un resultado positivo correcto a todos los grupos.\nStatistical Parity Difference: Diferencia en la tasa de predicciones positivas entre grupos. Evalúa si los grupos tienen igual probabilidad de ser clasificados como positivos, sin importar el resultado real.
description El conjunto de datos utilizado corresponde a la base de datos de COMPAS Recidivism, publicada por la organización ProPublica. Esta base contiene información de aproximadamente 7.000 personas arrestadas en el condado de Broward, Florida, durante los años 2013 y 2014, sobre reincidencia en el sistema judicial estadounidense.\nEl dataset se encuentra en formato CSV y contiene atributos que describen características demográficas, penales y judiciales de las personas evaluadas. El atributo objetivo o variable de clase es two_year_recid, que indica si la persona cometió un nuevo delito dentro de ese intervalo de tiempo.
2. Comprensión de los datos

A continuación, se describe el análisis de los datos disponibles para la construcción del modelo

2.1 Recopilación de datos iniciales

Cual fue la manera en que se llevó a cabo el proceso de recopilación de los datos, indicando si los datos utilizados corresponden a toda una población o si son una muestra representativa de la misma, especificando el porcentaje que representan en relación a la población en cuestión. Además, identificar las razones por las cuales existen valores perdidos en los datos. Asimismo, indicar si los datos han sido sometidos a algún tipo de tratamiento o transformación, o si se encuentran en su formato original

Ítem Descripción
Fuente de Datos El conjunto de datos utilizado corresponde a la base de datos de COMPAS Recidivism, publicada por la organización ProPublica. Esta base contiene información de aproximadamente 7.000 personas arrestadas en el condado de Broward, Florida, durante los años 2013 y 2014, sobre reincidencia en el sistema judicial estadounidense.
Filas 5771
Columnas 5
Atributos sensibles [race]
Atributo de clase two_year_recid
Formato
Descripción El conjunto de datos utilizado corresponde a la base de datos de COMPAS Recidivism, publicada por la organización ProPublica. Esta base contiene información de aproximadamente 7.000 personas arrestadas en el condado de Broward, Florida, durante los años 2013 y 2014, sobre reincidencia en el sistema judicial estadounidense.

2.2 Descripción de los datos

En esta sección se busca comprender la naturaleza y las características de cada atributo en el conjunto de datos. Esto implica examinar el tipo de dato, la escala de medición, el rango de valores posibles, la presencia de valores atípicos o perdidos, y cualquier otra información relevante relacionada con cada atributo

Atributo Descripción
sex Sexo de la persona evaluada. Generalmente toma los valores Male (hombre) o Female (mujer). Es considerado un atributo sensible o protegido.
age_cat Categoría de edad. Agrupa la edad cronológica en rangos como Less than 25, 25 - 45, y Greater than 45.
race Raza de la persona evaluada. Incluye categorías como African-American, Caucasian, Hispanic, Asian, Native American, etc. Es otro atributo sensible comúnmente analizado por su impacto en las predicciones.
priors_count Número de antecedentes penales antes del cargo actual. Es una variable numérica que indica cuántas veces la persona ha sido arrestada anteriormente.
c_charge_degree Gravedad del cargo más reciente. Suele codificarse como F (felonía, o delito grave) o M (misdemeanor, o delito menor).
two_year_recid Variable objetivo. Indica si la persona fue arrestada nuevamente dentro de los dos años posteriores a la evaluación. Es binaria: 1 si reincidió, 0 si no reincidió.

Estadística atributos ordinales y nominales

Atributo Tipo Cantidad Valores unicos Mas frecuente Menos frecuente Valores nulos
sex category 5771 2 0 1 0
age_cat category 5771 3 25 0 0
race category 5771 2 0 1 0
priors_count category 5771 3 3 0 0
c_charge_degree category 5771 2 1 0 0
two_year_recid category 5771 2 1 0 0

Estadística atributos continuos y discretos

Gráfico de Distribución de las Variables

Relación entre atributos

Registros del grupo privilegiado (`race` == 1): 1980 (34.31%)

col_0 Conteo two_year_recid 0 788 1 1192

2.4 Verificación de calidad de datos

En esta sección se determina que atributos deben ser intervenidos y como se debería realizar dicha intervención

Attribute Data Type Missing Values% Unique Values% Minimum Value Maximum Value DQ Issue
sex category 0.0 1 NaN NaN No issue
age_cat category 0.0 2 NaN NaN No issue
race category 0.0 1 NaN NaN No issue
priors_count category 0.0 2 NaN NaN No issue
c_charge_degree category 0.0 1 NaN NaN No issue
two_year_recid category 0.0 1 NaN NaN Target column
3. Preparación de los datos

En esta etapa los datos deben ser intervenidos con el fin de que tengan las representaciones adecuadas tanto del caso de uso que se está solucionando

Metrica Columna_1 Columna_2 Valor Ranking
Chi-cuadrado priors_count two_year_recid 465.532597 True
Chi-cuadrado age_cat priors_count 287.857129 True
Chi-cuadrado priors_count c_charge_degree 171.130398 True
Chi-cuadrado age_cat two_year_recid 143.128396 True
Chi-cuadrado age_cat race 141.142711 True
Chi-cuadrado sex priors_count 103.057212 True
Chi-cuadrado race priors_count 79.922280 True
Chi-cuadrado c_charge_degree two_year_recid 55.908188 True
Chi-cuadrado sex two_year_recid 47.347854 True
Chi-cuadrado sex race 37.322490 True

Este informe presenta el análisis de equidad realizado sobre el dataset y los modelos evaluados.

Group Non-Privileged Label Distribution Jensen-Shannon Divergence Kullback-Leibler Divergence Demographic Parity Theil Index (Overall) Theil Index (Within-group) Theil Index (Between-group)
Non-Privileged Group (race != 1) {1: 0.521762068055922, 0: 0.4782379319440781} 0.000237 0.000947 0.080258 0.0 0.0 0.0
Distribución de la Variable Objetivo
4. Modelado

En esta fase se prueban las técnicas y algoritmos de ML más adecuados para abordar el problema en cuestión

4.2 Generación de un diseño de comprobación

La clasificación se trata de predecir etiquetas de clase dados los datos de entrada. En clasificación binaria, hay dos clases de salida posibles; por lo tanto se establece cual valor corresponde a la clase positiva y cual a la negativa, adicionalmente la métrica de rendimiento que se utilizará para definir el mejor de los modelos

Metrica Descripcion Tipo
equal_opportunity_difference Diferencia en la tasa de verdaderos positivos (recall) entre grupos. Equidad
equalized_odds_difference la diferencia absoluta entre los grupos protegidos la tasa de verdaderos positivos (TPR) y la tasa de falsos positivos (FPR) Equidad
statistical_parity_difference Diferencia entre las tasas de resultados positivos entre grupos; indica disparidad de selección. Equidad
disparate_impact Razón entre la tasa de selección de un grupo y la de otro; detecta discriminación si es muy diferente de 1. Equidad
accuracy Proporción de predicciones correctas respecto al total de muestras; mide el rendimiento general de un modelo. Rendimiento
f1_score Media armónica entre precisión y recall; equilibra la importancia de falsos positivos y falsos negativos. Rendimiento
recall También llamado sensibilidad, mide la proporción de positivos reales que son identificados correctamente; ayuda a minimizar falsos negativos. Rendimiento

4.3 Generación de los modelos

Cual es el comportamiento de los modelos generados para cada una de las técnicas seleccionadas y de las métricas de rendimiento definidas

Algoritmo Fase Intervencion Proceso accuracy f1_score recall equal_opportunity_difference equalized_odds_difference statistical_parity_difference disparate_impact
AdaBoostClassifier BASE_LINE SMOTE SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
AdaBoostClassifier BASE_LINE ROS ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE RUS RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
GradientBoostingClassifier BASE_LINE RUS RUS 0.668053 0.706675 0.727617 -0.127352 0.177776 -0.182454 0.741069
XGBClassifier BASE_LINE RUS RUS 0.667360 0.704433 0.721311 -0.126631 0.163040 -0.176033 0.746384
RandomForestClassifier BASE_LINE RUS RUS 0.667360 0.704433 0.721311 -0.126631 0.163040 -0.176033 0.746384
AdaBoostClassifier BASE_LINE NONE BASE_LINE_VALUES 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
AdaBoostClassifier BASE_LINE HYPERPARAMETER HYPERPARAMETER 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
GradientBoostingClassifier BASE_LINE SMOTE SMOTE 0.665974 0.704294 0.723834 -0.133388 0.185512 -0.188691 0.733016
ExtraTreesClassifier BASE_LINE HYPERPARAMETER HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
XGBClassifier BASE_LINE ROS ROS 0.663202 0.703659 0.727617 -0.116571 0.139735 -0.159521 0.770173
GradientBoostingClassifier BASE_LINE NONE BASE_LINE_VALUES 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
RandomForestClassifier BASE_LINE NONE BASE_LINE_VALUES 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier BASE_LINE HYPERPARAMETER HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier BASE_LINE ROS ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
ExtraTreesClassifier BASE_LINE ROS ROS 0.661816 0.701711 0.723834 -0.122607 0.141854 -0.163649 0.764226
DecisionTreeClassifier BASE_LINE ROS ROS 0.661816 0.701711 0.723834 -0.122607 0.141854 -0.163649 0.764226
XGBClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
RandomForestClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
ExtraTreesClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
DecisionTreeClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
ExtraTreesClassifier BASE_LINE RUS RUS 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
DecisionTreeClassifier BASE_LINE RUS RUS 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
XGBClassifier BASE_LINE NONE BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
ExtraTreesClassifier BASE_LINE NONE BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
DecisionTreeClassifier BASE_LINE NONE BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
RandomForestClassifier BASE_LINE ROS ROS 0.656272 0.692689 0.704918 -0.071932 0.102528 -0.117236 0.818991
GradientBoostingClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
XGBClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
AdaBoostClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
RandomForestClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
ExtraTreesClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
DecisionTreeClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
5. Evaluación

Una vez establecido el modelo que se utilizará se procede nuevamente a realizar la evaluación de las métricas definidas, para revisar varios aspectos para comprender la calidad y el rendimiento del modelo

5.* Selección de métrica de equidad

Algunas de las métricas utilizadas para detectar la justicia en las decisiones que se toman, se soportan en el análisis de la matriz de confusión...

6. Intervenciones de Equidad

Integrar métodos de identificación y mitigación de sesgos en modelos de ML requiere una comprensión de los objetivos por el cual se requiere automatizar la toma de decisiones...

6.1 Preprocesamiento (Comprensión y preparación de los datos)

Consiste en ajustar los datos antes de iniciar el proceso de entrenamiento...

Algoritmo Fase Intervencion Proceso accuracy f1_score recall equal_opportunity_difference equalized_odds_difference statistical_parity_difference disparate_impact
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.676369 0.704991 0.703657 -0.084725 0.204771 -0.171219 0.741535
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.676369 0.704991 0.703657 -0.084725 0.204771 -0.171219 0.741535
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
GradientBoostingClassifier PREPROCESSING DEMV DEMV 0.674290 0.699488 0.689786 -0.090686 0.198510 -0.171977 0.735334
GradientBoostingClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.674290 0.699488 0.689786 -0.090686 0.198510 -0.171977 0.735334
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_BAL_GAN_FAIR 0.673597 0.693957 0.673392 -0.106062 0.200724 -0.182068 0.715180
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_DEMV 0.673597 0.693957 0.673392 -0.106062 0.200724 -0.182068 0.715180
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_BAL_GAN_FAIR 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_DEMV 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
AdaBoostClassifier PREPROCESSING DEMV HYPERPARAMETER 0.671518 0.696931 0.687264 -0.089320 0.209746 -0.175119 0.731372
AdaBoostClassifier PREPROCESSING BAL_GAN_FAIR HYPERPARAMETER 0.671518 0.696931 0.687264 -0.089320 0.209746 -0.175119 0.731372
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_SMOTE 0.670132 0.710814 0.737705 -0.100474 0.143973 -0.153329 0.779094
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_RUS 0.668746 0.710303 0.738966 -0.098462 0.145353 -0.152343 0.781180
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FOS 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING DEMV DEMV 0.667360 0.696970 0.696091 -0.080626 0.182203 -0.157620 0.758993
AdaBoostClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.667360 0.696970 0.696091 -0.080626 0.182203 -0.157620 0.758993
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.665974 0.703202 0.720050 -0.123253 0.168658 -0.176033 0.746384
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FOS 0.665281 0.714708 0.762926 -0.087185 0.140926 -0.142526 0.801885
ExtraTreesClassifier PREPROCESSING FOS HYPERPARAMETER 0.665281 0.710952 0.749054 -0.098537 0.133284 -0.146380 0.792884
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_BAL_GAN_FAIR 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_DEMV 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_ROS 0.663895 0.711138 0.752837 -0.103282 0.145901 -0.153832 0.785540
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
AdaBoostClassifier PREPROCESSING FOS FOS 0.662509 0.701410 0.721311 -0.045775 0.101790 -0.102833 0.841743
AdaBoostClassifier PREPROCESSING FOS HYPERPARAMETER 0.662509 0.701410 0.721311 -0.045775 0.101790 -0.102833 0.841743
ExtraTreesClassifier PREPROCESSING DEMV HYPERPARAMETER 0.661816 0.697270 0.708701 -0.001210 0.058965 -0.059607 0.901896
ExtraTreesClassifier PREPROCESSING BAL_GAN_FAIR HYPERPARAMETER 0.661816 0.697270 0.708701 -0.001210 0.058965 -0.059607 0.901896
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier PREPROCESSING FOS FOS 0.659044 0.701094 0.727617 -0.035714 0.072867 -0.084212 0.869979
GradientBoostingClassifier PREPROCESSING FOS HYPERPARAMETER 0.659044 0.701094 0.727617 -0.035714 0.072867 -0.084212 0.869979
GradientBoostingClassifier PREPROCESSING FOS FOS 0.658351 0.701393 0.730139 -0.042471 0.089721 -0.094760 0.856037
ExtraTreesClassifier PREPROCESSING FOS FOS 0.658351 0.699573 0.723834 -0.041751 0.069368 -0.086230 0.866428
DecisionTreeClassifier PREPROCESSING FOS FOS 0.658351 0.699573 0.723834 -0.041751 0.069368 -0.086230 0.866428
XGBClassifier PREPROCESSING FOS FOS 0.657658 0.699147 0.723834 -0.041751 0.074986 -0.088340 0.863606
GradientBoostingClassifier PREPROCESSING DEMV HYPERPARAMETER 0.656272 0.697929 0.722573 -0.022201 0.072867 -0.075773 0.881464
GradientBoostingClassifier PREPROCESSING BAL_GAN_FAIR HYPERPARAMETER 0.656272 0.697929 0.722573 -0.022201 0.072867 -0.075773 0.881464
XGBClassifier PREPROCESSING DEMV DEMV 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
RandomForestClassifier PREPROCESSING DEMV DEMV 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
XGBClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
RandomForestClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
ExtraTreesClassifier PREPROCESSING DEMV DEMV 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
DecisionTreeClassifier PREPROCESSING DEMV DEMV 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
ExtraTreesClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
DecisionTreeClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
AdaBoostClassifier PREPROCESSING FAIR_GAN HYPERPARAMETER 0.616078 0.672577 0.717528 -0.251258 0.251258 -0.262942 0.671149
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.611227 0.654344 0.669609 -0.090536 0.090536 -0.098523 0.846383
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_GAN 0.611227 0.654344 0.669609 -0.090536 0.090536 -0.098523 0.846383
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.610534 0.685330 0.771753 -0.078491 0.078491 -0.093676 0.875274
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.604297 0.676120 0.751576 -0.072951 0.072951 -0.082853 0.886167
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.595981 0.491718 0.355612 -0.176478 0.176478 -0.184472 0.500345
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_SMOTE 0.595981 0.491718 0.355612 -0.176478 0.176478 -0.184472 0.500345
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_GAN 0.592516 0.690200 0.825977 -0.078219 0.078219 -0.072344 0.911163
AdaBoostClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.592516 0.640147 0.659521 -0.343813 0.343813 -0.322798 0.596290
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.591823 0.482880 0.346784 -0.158220 0.158220 -0.164452 0.530419
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
ExtraTreesClassifier PREPROCESSING FAIR_GAN HYPERPARAMETER 0.575884 0.682243 0.828499 -0.160442 0.237122 -0.200533 0.781989
GradientBoostingClassifier PREPROCESSING FAIR_GAN HYPERPARAMETER 0.566875 0.625075 0.656999 -0.293933 0.404875 -0.348434 0.585030
XGBClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.565489 0.623423 0.654477 -0.287176 0.404875 -0.344215 0.587985
RandomForestClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.562024 0.617433 0.643127 -0.316065 0.421086 -0.367056 0.563949
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_SMOTE 0.562024 0.404896 0.271122 -0.128011 0.128011 -0.127673 0.530876
GradientBoostingClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.559252 0.618247 0.649433 -0.241320 0.332389 -0.286632 0.640572
DecisionTreeClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.553708 0.604908 0.621690 -0.210119 0.369787 -0.282942 0.632563
ExtraTreesClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.550243 0.599630 0.612863 -0.234984 0.381761 -0.301655 0.611455
AdaBoostClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539848 0.365201 0.240858 -0.645270 0.645270 -0.533755 0.000000
AdaBoostClassifier PREPROCESSING FAIR_SMOTE HYPERPARAMETER 0.539848 0.365201 0.240858 -0.645270 0.645270 -0.533755 0.000000
XGBClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
RandomForestClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
ExtraTreesClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
DecisionTreeClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
ExtraTreesClassifier PREPROCESSING FAIR_SMOTE HYPERPARAMETER 0.532918 0.330020 0.209332 -0.560811 0.560811 -0.449367 0.000000
GradientBoostingClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.532225 0.336283 0.215637 -0.577703 0.577703 -0.472574 0.000000
GradientBoostingClassifier PREPROCESSING FAIR_SMOTE HYPERPARAMETER 0.531532 0.338552 0.218159 -0.584459 0.584459 -0.483122 0.000000

6.2 Procesamiento (Modelado)

En este caso los datos originales no se ajustan, sino que se optimiza un modelo para que además de ser preciso sea justo...

Algoritmo Fase Intervencion Proceso accuracy f1_score recall equal_opportunity_difference equalized_odds_difference statistical_parity_difference disparate_impact
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE DEMV 0.672211 0.685714 0.650694 -0.126108 0.211412 -0.198306 0.683512
NEURONAL_NETWORK IN_PROCESSING DISTRACTION SMOTE 0.670132 0.715311 0.754098 -0.085098 0.131903 -0.139064 0.802053
NEURONAL_NETWORK IN_PROCESSING RULER ROS 0.668746 0.711701 0.744010 -0.117366 0.183298 -0.178646 0.751677
NEURONAL_NETWORK IN_PROCESSING RULER SMOTE 0.668053 0.711966 0.746532 -0.124123 0.200152 -0.189194 0.740815
NEURONAL_NETWORK IN_PROCESSING RULER RUS 0.667360 0.711885 0.747793 -0.122111 0.195915 -0.186098 0.745056
NEURONAL_NETWORK IN_PROCESSING RULER UNAWARENESS 0.666667 0.711803 0.749054 -0.120099 0.191678 -0.183002 0.749298
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE UNAWARENESS 0.665281 0.726346 0.808323 -0.068655 0.142021 -0.131056 0.827920
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE SMOTE 0.665281 0.726346 0.808323 -0.068655 0.142021 -0.131056 0.827920
NEURONAL_NETWORK IN_PROCESSING RULER FOS 0.664588 0.712930 0.757881 -0.084453 0.116335 -0.130900 0.814787
NEURONAL_NETWORK IN_PROCESSING DISTRACTION ROS 0.663895 0.719815 0.785624 -0.088701 0.152709 -0.147294 0.803331
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE ROS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE RUS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE FOS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE BAL_GAN_FAIR 0.663202 0.672507 0.629256 -0.122580 0.196677 -0.188561 0.688579
NEURONAL_NETWORK IN_PROCESSING DISTRACTION UNAWARENESS 0.662509 0.713023 0.762926 -0.097966 0.155661 -0.154106 0.788883
NEURONAL_NETWORK IN_PROCESSING DISTRACTION FOS 0.661123 0.720412 0.794451 -0.031493 0.075248 -0.081593 0.886250
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM BAL_GAN_FAIR 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM DEMV 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD BAL_GAN_FAIR 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD DEMV 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING DISTRACTION RUS 0.654193 0.693301 0.711223 -0.180461 0.186155 -0.213779 0.703710
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM UNAWARENESS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM ROS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD UNAWARENESS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD ROS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
NEURONAL_NETWORK IN_PROCESSING DISTRACTION BAL_GAN_FAIR 0.652114 0.689356 0.702396 0.015682 0.024424 -0.033487 0.943512
NEURONAL_NETWORK IN_PROCESSING RULER DEMV 0.652114 0.675711 0.659521 0.044300 0.044300 -0.021979 0.959145
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER UNAWARENESS 0.647263 0.686383 0.702396 -0.086737 0.141116 -0.139365 0.791613
NEURONAL_NETWORK IN_PROCESSING RULER BAL_GAN_FAIR 0.645877 0.671805 0.659521 0.044300 0.044300 -0.006407 0.987995
NEURONAL_NETWORK IN_PROCESSING DISTRACTION DEMV 0.643798 0.672194 0.664565 0.036177 0.036177 -0.020189 0.963335
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER FOS 0.643105 0.673431 0.669609 0.001101 0.028756 -0.042318 0.925982
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM SMOTE 0.641026 0.622999 0.539723 -0.130676 0.163255 -0.176412 0.661461
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD SMOTE 0.641026 0.622999 0.539723 -0.130676 0.163255 -0.176412 0.661461
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM RUS 0.636175 0.622030 0.544767 -0.133409 0.147686 -0.170357 0.677003
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD RUS 0.636175 0.622030 0.544767 -0.133409 0.147686 -0.170357 0.677003
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER ROS 0.635482 0.637741 0.583859 -0.135720 0.149519 -0.171317 0.700353
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM FOS 0.634789 0.602264 0.503153 -0.156683 0.159208 -0.189279 0.618220
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD FOS 0.634789 0.602264 0.503153 -0.156683 0.159208 -0.189279 0.618220
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER SMOTE 0.631324 0.631579 0.575032 -0.149804 0.151638 -0.179573 0.685913
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER RUS 0.631324 0.631579 0.575032 -0.149804 0.151638 -0.179573 0.685913
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE FAIR_GAN 0.607069 0.686913 0.784363 -0.079932 0.079932 -0.086726 0.886441
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE FAIR_SMOTE 0.595981 0.491718 0.355612 -0.176478 0.176478 -0.184472 0.500345
NEURONAL_NETWORK IN_PROCESSING RULER FAIR_GAN 0.581428 0.654857 0.722573 -0.356409 0.470720 -0.413580 0.560455
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM FAIR_GAN 0.570340 0.609079 0.609079 -0.073916 0.073916 -0.070731 0.881532
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD FAIR_GAN 0.570340 0.609079 0.609079 -0.073916 0.073916 -0.070731 0.881532
NEURONAL_NETWORK IN_PROCESSING FairODTrainer SMOTE 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING FairODTrainer BAL_GAN_FAIR 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING FairODTrainer DEMV 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING FairODTrainer FAIR_GAN 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING DISTRACTION FAIR_GAN 0.541234 0.591862 0.605296 -0.295571 0.397877 -0.341465 0.575185
NEURONAL_NETWORK IN_PROCESSING RULER FAIR_SMOTE 0.533611 0.334322 0.213115 -0.570946 0.570946 -0.459916 0.000000
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM FAIR_SMOTE 0.533611 0.323618 0.203026 -0.069559 0.069559 -0.071149 0.621074
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD FAIR_SMOTE 0.533611 0.323618 0.203026 -0.069559 0.069559 -0.071149 0.621074
NEURONAL_NETWORK IN_PROCESSING DISTRACTION FAIR_SMOTE 0.531532 0.335953 0.215637 -0.577703 0.577703 -0.474684 0.000000
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER FAIR_GAN 0.471240 0.097041 0.051702 -0.138514 0.138514 -0.109705 0.000000
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER FAIR_SMOTE 0.450450 0.000000 0.000000 0.000000 0.000000 0.000000 NaN
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER BAL_GAN_FAIR 0.450450 0.000000 0.000000 0.000000 0.000000 0.000000 NaN
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER DEMV 0.450450 0.000000 0.000000 0.000000 0.000000 0.000000 NaN

6.3 Post-procesamiento (Evaluación)

Estos métodos están encaminados a buscar la generación de resultados más justos.

Algoritmo Fase Intervencion Proceso accuracy f1_score recall equal_opportunity_difference equalized_odds_difference statistical_parity_difference disparate_impact
GradientBoostingClassifier POSTPROCESSING RejectOptionClassification GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING EqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING CalibratedEqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier POSTPROCESSING RejectOptionClassification XGBClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier POSTPROCESSING EqOddsPostprocessing XGBClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier POSTPROCESSING CalibratedEqOddsPostprocessing XGBClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING RejectOptionClassification AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING EqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING CalibratedEqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
RandomForestClassifier POSTPROCESSING RejectOptionClassification RandomForestClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
RandomForestClassifier POSTPROCESSING EqOddsPostprocessing RandomForestClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
RandomForestClassifier POSTPROCESSING CalibratedEqOddsPostprocessing RandomForestClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING RejectOptionClassification ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING EqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING CalibratedEqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
DecisionTreeClassifier POSTPROCESSING RejectOptionClassification DecisionTreeClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
DecisionTreeClassifier POSTPROCESSING EqOddsPostprocessing DecisionTreeClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
DecisionTreeClassifier POSTPROCESSING CalibratedEqOddsPostprocessing DecisionTreeClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING RejectOptionClassification ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING EqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING CalibratedEqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING RejectOptionClassification AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING EqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING CalibratedEqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING RejectOptionClassification GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING EqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING CalibratedEqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING RejectOptionClassification BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING RejectOptionClassification BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING RejectOptionClassification DEMV_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing DEMV_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing DEMV_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification ROS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing ROS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing ROS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification RUS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing RUS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing RUS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING RejectOptionClassification SMOTE_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing SMOTE_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing SMOTE_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING RejectOptionClassification NONE_BASE_LINE_VALUES 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING EqOddsPostprocessing NONE_BASE_LINE_VALUES 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING CalibratedEqOddsPostprocessing NONE_BASE_LINE_VALUES 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING FairnessAwareMetaEstimator AdaBoostClassifier 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
AdaBoostClassifier POSTPROCESSING FairnessAwareMetaEstimator AdaBoostClassifier 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator FOS_HYPERPARAMETER 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
GradientBoostingClassifier POSTPROCESSING FairnessAwareMetaEstimator GradientBoostingClassifier 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
ExtraTreesClassifier POSTPROCESSING FairnessAwareMetaEstimator ExtraTreesClassifier 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier POSTPROCESSING FairnessAwareMetaEstimator GradientBoostingClassifier 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator BAL_GAN_FAIR_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator BAL_GAN_FAIR_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator DEMV_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator FOS_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator ROS_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator RUS_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator SMOTE_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
XGBClassifier POSTPROCESSING FairnessAwareMetaEstimator XGBClassifier 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
ExtraTreesClassifier POSTPROCESSING FairnessAwareMetaEstimator ExtraTreesClassifier 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
DecisionTreeClassifier POSTPROCESSING FairnessAwareMetaEstimator DecisionTreeClassifier 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING FairnessAwareMetaEstimator NONE_BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
RandomForestClassifier POSTPROCESSING FairnessAwareMetaEstimator RandomForestClassifier 0.661123 0.704888 0.736444 -0.140220 0.195915 -0.195386 0.732332
AdaBoostClassifier POSTPROCESSING ThresholdOptimizer AdaBoostClassifier 0.648649 0.679317 0.677175 0.072469 0.072469 0.002652 1.004872
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer FOS_HYPERPARAMETER 0.648649 0.679317 0.677175 0.072469 0.072469 0.002652 1.004872
GradientBoostingClassifier POSTPROCESSING ThresholdOptimizer GradientBoostingClassifier 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer BAL_GAN_FAIR_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer DEMV_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer FOS_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer ROS_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer RUS_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer SMOTE_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
AdaBoostClassifier POSTPROCESSING ThresholdOptimizer AdaBoostClassifier 0.645184 0.675539 0.672131 0.091373 0.091373 0.012123 1.022623
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer BAL_GAN_FAIR_HYPERPARAMETER 0.644491 0.686239 0.707440 0.066854 0.066854 -0.004455 0.992405
XGBClassifier POSTPROCESSING ThresholdOptimizer XGBClassifier 0.644491 0.678773 0.683480 0.066358 0.066358 0.006597 1.011935
ExtraTreesClassifier POSTPROCESSING ThresholdOptimizer ExtraTreesClassifier 0.644491 0.678773 0.683480 0.082529 0.082529 0.022305 1.041139
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING ThresholdOptimizer NONE_BASE_LINE_VALUES 0.644491 0.678773 0.683480 0.066358 0.066358 0.006597 1.011935
ExtraTreesClassifier POSTPROCESSING ThresholdOptimizer ExtraTreesClassifier 0.641719 0.677882 0.686003 0.059601 0.059601 -0.007139 0.987420
GradientBoostingClassifier POSTPROCESSING ThresholdOptimizer GradientBoostingClassifier 0.640333 0.676232 0.683480 0.082529 0.082529 0.006505 1.011680
RandomForestClassifier POSTPROCESSING ThresholdOptimizer RandomForestClassifier 0.638947 0.667518 0.659521 0.049690 0.049690 -0.011796 0.978328
DecisionTreeClassifier POSTPROCESSING ThresholdOptimizer DecisionTreeClassifier 0.637561 0.673737 0.680958 0.078505 0.078505 -0.002920 0.994817
6.4 Reporte final

Al finalizar el entrenamiento, se obtiene un conjunto de modelos construidos mediante intervenciones de equidad que cumplen con los criterios de la frontera de Pareto. Las métricas asociadas a estos modelos son analizadas para identificar las intervenciones más prometedoras, las cuales se considerarán en la recomendación final sobre las fases más apropiadas del proceso de machine learning para implementar dichas intervenciones.

Algoritmo Fase Intervencion Proceso accuracy f1_score recall equal_opportunity_difference equalized_odds_difference statistical_parity_difference disparate_impact
GradientBoostingClassifier POSTPROCESSING RejectOptionClassification GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING EqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING CalibratedEqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier POSTPROCESSING RejectOptionClassification XGBClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier POSTPROCESSING EqOddsPostprocessing XGBClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier POSTPROCESSING CalibratedEqOddsPostprocessing XGBClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING RejectOptionClassification AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING EqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING CalibratedEqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
RandomForestClassifier POSTPROCESSING RejectOptionClassification RandomForestClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
RandomForestClassifier POSTPROCESSING EqOddsPostprocessing RandomForestClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
RandomForestClassifier POSTPROCESSING CalibratedEqOddsPostprocessing RandomForestClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING RejectOptionClassification ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING EqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING CalibratedEqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
DecisionTreeClassifier POSTPROCESSING RejectOptionClassification DecisionTreeClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
DecisionTreeClassifier POSTPROCESSING EqOddsPostprocessing DecisionTreeClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
DecisionTreeClassifier POSTPROCESSING CalibratedEqOddsPostprocessing DecisionTreeClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING RejectOptionClassification ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING EqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier POSTPROCESSING CalibratedEqOddsPostprocessing ExtraTreesClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING RejectOptionClassification AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING EqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier POSTPROCESSING CalibratedEqOddsPostprocessing AdaBoostClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING RejectOptionClassification GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING EqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier POSTPROCESSING CalibratedEqOddsPostprocessing GradientBoostingClassifier 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING RejectOptionClassification BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING RejectOptionClassification BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing BAL_GAN_FAIR_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING RejectOptionClassification DEMV_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing DEMV_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing DEMV_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing FOS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification ROS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing ROS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing ROS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING RejectOptionClassification RUS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing RUS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing RUS_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING RejectOptionClassification SMOTE_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING EqOddsPostprocessing SMOTE_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING CalibratedEqOddsPostprocessing SMOTE_HYPERPARAMETER 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING RejectOptionClassification NONE_BASE_LINE_VALUES 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING EqOddsPostprocessing NONE_BASE_LINE_VALUES 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING CalibratedEqOddsPostprocessing NONE_BASE_LINE_VALUES 1.000000 1.000000 1.000000 0.000000 0.000000 -0.111573 0.821333
NN_CONFIG BASE_LINE NONE NN 0.679834 0.704225 0.693569 -0.181678 0.270996 -0.255725 0.637085
AdaBoostClassifier BASE_LINE SMOTE SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
AdaBoostClassifier BASE_LINE SMOTE HYPERPARAMETER 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
AdaBoostClassifier BASE_LINE FAIR_PCA SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
AdaBoostClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_SMOTE 0.677755 0.701349 0.688525 -0.098089 0.195748 -0.176059 0.728169
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.676369 0.704991 0.703657 -0.084725 0.204771 -0.171219 0.741535
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.676369 0.704991 0.703657 -0.084725 0.204771 -0.171219 0.741535
AdaBoostClassifier BASE_LINE ROS ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE ROS HYPERPARAMETER 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE RUS RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE RUS HYPERPARAMETER 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE FAIR_PCA ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE FAIR_PCA RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_ROS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_RUS 0.676369 0.700833 0.689786 -0.096076 0.197129 -0.175073 0.730570
GradientBoostingClassifier PREPROCESSING DEMV DEMV 0.674290 0.699488 0.689786 -0.090686 0.198510 -0.171977 0.735334
GradientBoostingClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.674290 0.699488 0.689786 -0.090686 0.198510 -0.171977 0.735334
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_BAL_GAN_FAIR 0.673597 0.693957 0.673392 -0.106062 0.200724 -0.182068 0.715180
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_DEMV 0.673597 0.693957 0.673392 -0.106062 0.200724 -0.182068 0.715180
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_BAL_GAN_FAIR 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_DEMV 0.672211 0.697764 0.688525 -0.092698 0.209746 -0.177228 0.729012
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE DEMV 0.672211 0.685714 0.650694 -0.126108 0.211412 -0.198306 0.683512
AdaBoostClassifier PREPROCESSING DEMV HYPERPARAMETER 0.671518 0.696931 0.687264 -0.089320 0.209746 -0.175119 0.731372
AdaBoostClassifier PREPROCESSING BAL_GAN_FAIR HYPERPARAMETER 0.671518 0.696931 0.687264 -0.089320 0.209746 -0.175119 0.731372
NEURONAL_NETWORK IN_PROCESSING DISTRACTION SMOTE 0.670132 0.715311 0.754098 -0.085098 0.131903 -0.139064 0.802053
ExtraTreesClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_SMOTE 0.670132 0.710814 0.737705 -0.100474 0.143973 -0.153329 0.779094
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_SMOTE 0.670132 0.710814 0.737705 -0.100474 0.143973 -0.153329 0.779094
NEURONAL_NETWORK IN_PROCESSING RULER ROS 0.668746 0.711701 0.744010 -0.117366 0.183298 -0.178646 0.751677
ExtraTreesClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_RUS 0.668746 0.710303 0.738966 -0.098462 0.145353 -0.152343 0.781180
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_RUS 0.668746 0.710303 0.738966 -0.098462 0.145353 -0.152343 0.781180
NEURONAL_NETWORK IN_PROCESSING RULER SMOTE 0.668053 0.711966 0.746532 -0.124123 0.200152 -0.189194 0.740815
GradientBoostingClassifier BASE_LINE RUS RUS 0.668053 0.706675 0.727617 -0.127352 0.177776 -0.182454 0.741069
NEURONAL_NETWORK IN_PROCESSING RULER RUS 0.667360 0.711885 0.747793 -0.122111 0.195915 -0.186098 0.745056
AdaBoostClassifier BASE_LINE FAIR_PCA FAIR_PCA 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier BASE_LINE FAIR_PCA HYPERPARAMETER 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FOS 0.667360 0.710495 0.742749 -0.103207 0.157970 -0.159795 0.773901
XGBClassifier BASE_LINE RUS RUS 0.667360 0.704433 0.721311 -0.126631 0.163040 -0.176033 0.746384
RandomForestClassifier BASE_LINE RUS RUS 0.667360 0.704433 0.721311 -0.126631 0.163040 -0.176033 0.746384
AdaBoostClassifier PREPROCESSING DEMV DEMV 0.667360 0.696970 0.696091 -0.080626 0.182203 -0.157620 0.758993
AdaBoostClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.667360 0.696970 0.696091 -0.080626 0.182203 -0.157620 0.758993
NEURONAL_NETWORK IN_PROCESSING RULER UNAWARENESS 0.666667 0.711803 0.749054 -0.120099 0.191678 -0.183002 0.749298
AdaBoostClassifier BASE_LINE NONE BASE_LINE_VALUES 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
AdaBoostClassifier BASE_LINE HYPERPARAMETER HYPERPARAMETER 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
AdaBoostClassifier POSTPROCESSING FairnessAwareMetaEstimator AdaBoostClassifier 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
AdaBoostClassifier POSTPROCESSING FairnessAwareMetaEstimator AdaBoostClassifier 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator FOS_HYPERPARAMETER 0.665974 0.710337 0.745271 -0.109964 0.180442 -0.172454 0.760284
GradientBoostingClassifier BASE_LINE SMOTE SMOTE 0.665974 0.704294 0.723834 -0.133388 0.185512 -0.188691 0.733016
GradientBoostingClassifier BASE_LINE FAIR_PCA SMOTE 0.665974 0.703202 0.720050 -0.123253 0.168658 -0.176033 0.746384
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.665974 0.703202 0.720050 -0.123253 0.168658 -0.176033 0.746384
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE UNAWARENESS 0.665281 0.726346 0.808323 -0.068655 0.142021 -0.131056 0.827920
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE SMOTE 0.665281 0.726346 0.808323 -0.068655 0.142021 -0.131056 0.827920
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FOS 0.665281 0.714708 0.762926 -0.087185 0.140926 -0.142526 0.801885
ExtraTreesClassifier BASE_LINE ROS HYPERPARAMETER 0.665281 0.710952 0.749054 -0.098537 0.133284 -0.146380 0.792884
ExtraTreesClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_ROS 0.665281 0.710952 0.749054 -0.098537 0.133284 -0.146380 0.792884
ExtraTreesClassifier PREPROCESSING FOS HYPERPARAMETER 0.665281 0.710952 0.749054 -0.098537 0.133284 -0.146380 0.792884
NEURONAL_NETWORK IN_PROCESSING RULER FOS 0.664588 0.712930 0.757881 -0.084453 0.116335 -0.130900 0.814787
NEURONAL_NETWORK IN_PROCESSING DISTRACTION ROS 0.663895 0.719815 0.785624 -0.088701 0.152709 -0.147294 0.803331
ExtraTreesClassifier BASE_LINE HYPERPARAMETER HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier BASE_LINE FAIR_PCA FAIR_PCA 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
XGBClassifier BASE_LINE FAIR_PCA FAIR_PCA 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
RandomForestClassifier BASE_LINE FAIR_PCA FAIR_PCA 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier BASE_LINE FAIR_PCA FAIR_PCA 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
DecisionTreeClassifier BASE_LINE FAIR_PCA FAIR_PCA 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier BASE_LINE FAIR_PCA HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier BASE_LINE FAIR_PCA HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_BAL_GAN_FAIR 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_DEMV 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE ROS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE RUS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE FOS 0.663895 0.714874 0.766709 -0.091930 0.153542 -0.149978 0.794538
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_ROS 0.663895 0.711138 0.752837 -0.103282 0.145901 -0.153832 0.785540
XGBClassifier BASE_LINE ROS ROS 0.663202 0.703659 0.727617 -0.116571 0.139735 -0.159521 0.770173
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE BAL_GAN_FAIR 0.663202 0.672507 0.629256 -0.122580 0.196677 -0.188561 0.688579
NEURONAL_NETWORK IN_PROCESSING DISTRACTION UNAWARENESS 0.662509 0.713023 0.762926 -0.097966 0.155661 -0.154106 0.788883
GradientBoostingClassifier BASE_LINE NONE BASE_LINE_VALUES 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
RandomForestClassifier BASE_LINE NONE BASE_LINE_VALUES 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier BASE_LINE HYPERPARAMETER HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier POSTPROCESSING FairnessAwareMetaEstimator GradientBoostingClassifier 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
ExtraTreesClassifier POSTPROCESSING FairnessAwareMetaEstimator ExtraTreesClassifier 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier POSTPROCESSING FairnessAwareMetaEstimator GradientBoostingClassifier 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator BAL_GAN_FAIR_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator BAL_GAN_FAIR_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator DEMV_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator FOS_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator ROS_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator RUS_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING FairnessAwareMetaEstimator SMOTE_HYPERPARAMETER 0.662509 0.710979 0.755359 -0.110039 0.168373 -0.166490 0.771918
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FOS 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_BAL_GAN_FAIR 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_DEMV 0.662509 0.707858 0.744010 -0.111976 0.164231 -0.166216 0.768275
GradientBoostingClassifier BASE_LINE ROS ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier BASE_LINE FAIR_PCA ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
XGBClassifier BASE_LINE FAIR_PCA ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
RandomForestClassifier BASE_LINE FAIR_PCA ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
ExtraTreesClassifier BASE_LINE FAIR_PCA ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
DecisionTreeClassifier BASE_LINE FAIR_PCA ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier BASE_LINE FAIR_PCA RUS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_ROS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FOS 0.662509 0.703951 0.730139 -0.123328 0.156589 -0.170070 0.758644
AdaBoostClassifier PREPROCESSING FOS FOS 0.662509 0.701410 0.721311 -0.045775 0.101790 -0.102833 0.841743
AdaBoostClassifier PREPROCESSING FOS HYPERPARAMETER 0.662509 0.701410 0.721311 -0.045775 0.101790 -0.102833 0.841743
ExtraTreesClassifier BASE_LINE ROS ROS 0.661816 0.701711 0.723834 -0.122607 0.141854 -0.163649 0.764226
DecisionTreeClassifier BASE_LINE ROS ROS 0.661816 0.701711 0.723834 -0.122607 0.141854 -0.163649 0.764226
ExtraTreesClassifier PREPROCESSING DEMV HYPERPARAMETER 0.661816 0.697270 0.708701 -0.001210 0.058965 -0.059607 0.901896
ExtraTreesClassifier PREPROCESSING BAL_GAN_FAIR HYPERPARAMETER 0.661816 0.697270 0.708701 -0.001210 0.058965 -0.059607 0.901896
XGBClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
RandomForestClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
ExtraTreesClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
DecisionTreeClassifier BASE_LINE SMOTE SMOTE 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
GradientBoostingClassifier BASE_LINE SMOTE HYPERPARAMETER 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
ExtraTreesClassifier BASE_LINE RUS RUS 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
DecisionTreeClassifier BASE_LINE RUS RUS 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
GradientBoostingClassifier BASE_LINE RUS HYPERPARAMETER 0.661816 0.695381 0.702396 -0.075956 0.123715 -0.129619 0.799871
NEURONAL_NETWORK IN_PROCESSING DISTRACTION FOS 0.661123 0.720412 0.794451 -0.031493 0.075248 -0.081593 0.886250
XGBClassifier BASE_LINE NONE BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
ExtraTreesClassifier BASE_LINE NONE BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
DecisionTreeClassifier BASE_LINE NONE BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
XGBClassifier POSTPROCESSING FairnessAwareMetaEstimator XGBClassifier 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
ExtraTreesClassifier POSTPROCESSING FairnessAwareMetaEstimator ExtraTreesClassifier 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
DecisionTreeClassifier POSTPROCESSING FairnessAwareMetaEstimator DecisionTreeClassifier 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING FairnessAwareMetaEstimator NONE_BASE_LINE_VALUES 0.661123 0.709102 0.751576 -0.116075 0.170491 -0.170618 0.766263
RandomForestClassifier POSTPROCESSING FairnessAwareMetaEstimator RandomForestClassifier 0.661123 0.704888 0.736444 -0.140220 0.195915 -0.195386 0.732332
XGBClassifier BASE_LINE FAIR_PCA SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier BASE_LINE FAIR_PCA SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
ExtraTreesClassifier BASE_LINE FAIR_PCA SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
DecisionTreeClassifier BASE_LINE FAIR_PCA SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
GradientBoostingClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
XGBClassifier BASE_LINE FAIR_PCA RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier BASE_LINE FAIR_PCA RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
ExtraTreesClassifier BASE_LINE FAIR_PCA RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
DecisionTreeClassifier BASE_LINE FAIR_PCA RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
GradientBoostingClassifier BASE_LINE FAIR_PCA HYPERPARAMETER_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_SMOTE 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_RUS 0.661123 0.701647 0.725095 -0.125986 0.153090 -0.169978 0.757320
RandomForestClassifier PREPROCESSING FOS FOS 0.659044 0.701094 0.727617 -0.035714 0.072867 -0.084212 0.869979
GradientBoostingClassifier PREPROCESSING FOS HYPERPARAMETER 0.659044 0.701094 0.727617 -0.035714 0.072867 -0.084212 0.869979
GradientBoostingClassifier PREPROCESSING FOS FOS 0.658351 0.701393 0.730139 -0.042471 0.089721 -0.094760 0.856037
ExtraTreesClassifier PREPROCESSING FOS FOS 0.658351 0.699573 0.723834 -0.041751 0.069368 -0.086230 0.866428
DecisionTreeClassifier PREPROCESSING FOS FOS 0.658351 0.699573 0.723834 -0.041751 0.069368 -0.086230 0.866428
ExtraTreesClassifier BASE_LINE SMOTE HYPERPARAMETER 0.658351 0.684984 0.675914 -0.204456 0.227242 -0.246346 0.648290
ExtraTreesClassifier BASE_LINE RUS HYPERPARAMETER 0.658351 0.684984 0.675914 -0.204456 0.227242 -0.246346 0.648290
XGBClassifier PREPROCESSING FOS FOS 0.657658 0.699147 0.723834 -0.041751 0.074986 -0.088340 0.863606
GradientBoostingClassifier PREPROCESSING DEMV HYPERPARAMETER 0.656272 0.697929 0.722573 -0.022201 0.072867 -0.075773 0.881464
GradientBoostingClassifier PREPROCESSING BAL_GAN_FAIR HYPERPARAMETER 0.656272 0.697929 0.722573 -0.022201 0.072867 -0.075773 0.881464
RandomForestClassifier BASE_LINE ROS ROS 0.656272 0.692689 0.704918 -0.071932 0.102528 -0.117236 0.818991
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM BAL_GAN_FAIR 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM DEMV 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD BAL_GAN_FAIR 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD DEMV 0.654193 0.706643 0.757881 -0.079062 0.092292 -0.115420 0.836690
NEURONAL_NETWORK IN_PROCESSING DISTRACTION RUS 0.654193 0.693301 0.711223 -0.180461 0.186155 -0.213779 0.703710
GradientBoostingClassifier BASE_LINE ROS HYPERPARAMETER 0.654193 0.692923 0.709962 -0.085445 0.141854 -0.140442 0.790661
XGBClassifier PREPROCESSING DEMV DEMV 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
RandomForestClassifier PREPROCESSING DEMV DEMV 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
XGBClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
RandomForestClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.653500 0.689441 0.699874 -0.058418 0.102528 -0.108797 0.829803
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM UNAWARENESS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM ROS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD UNAWARENESS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD ROS 0.653500 0.669312 0.638083 -0.097715 0.190868 -0.169090 0.723625
ExtraTreesClassifier PREPROCESSING DEMV DEMV 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
DecisionTreeClassifier PREPROCESSING DEMV DEMV 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
ExtraTreesClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
DecisionTreeClassifier PREPROCESSING BAL_GAN_FAIR BAL_GAN_FAIR 0.652807 0.688239 0.697352 -0.051661 0.096910 -0.102468 0.838101
NEURONAL_NETWORK IN_PROCESSING DISTRACTION BAL_GAN_FAIR 0.652114 0.689356 0.702396 0.015682 0.024424 -0.033487 0.943512
NEURONAL_NETWORK IN_PROCESSING RULER DEMV 0.652114 0.675711 0.659521 0.044300 0.044300 -0.021979 0.959145
AdaBoostClassifier POSTPROCESSING ThresholdOptimizer AdaBoostClassifier 0.648649 0.679317 0.677175 0.072469 0.072469 0.002652 1.004872
AdaBoostClassifier_FOS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer FOS_HYPERPARAMETER 0.648649 0.679317 0.677175 0.072469 0.072469 0.002652 1.004872
GradientBoostingClassifier POSTPROCESSING ThresholdOptimizer GradientBoostingClassifier 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer BAL_GAN_FAIR_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_DEMV_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer DEMV_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_FOS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer FOS_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_ROS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer ROS_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_RUS_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer RUS_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GradientBoostingClassifier_SMOTE_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer SMOTE_HYPERPARAMETER 0.647956 0.683292 0.691047 0.062259 0.062259 0.004396 1.007863
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER UNAWARENESS 0.647263 0.686383 0.702396 -0.086737 0.141116 -0.139365 0.791613
NEURONAL_NETWORK IN_PROCESSING RULER BAL_GAN_FAIR 0.645877 0.671805 0.659521 0.044300 0.044300 -0.006407 0.987995
AdaBoostClassifier POSTPROCESSING ThresholdOptimizer AdaBoostClassifier 0.645184 0.675539 0.672131 0.091373 0.091373 0.012123 1.022623
ExtraTreesClassifier_BAL_GAN_FAIR_HYPERPARAMETER POSTPROCESSING ThresholdOptimizer BAL_GAN_FAIR_HYPERPARAMETER 0.644491 0.686239 0.707440 0.066854 0.066854 -0.004455 0.992405
ExtraTreesClassifier POSTPROCESSING ThresholdOptimizer ExtraTreesClassifier 0.644491 0.678773 0.683480 0.082529 0.082529 0.022305 1.041139
XGBClassifier POSTPROCESSING ThresholdOptimizer XGBClassifier 0.644491 0.678773 0.683480 0.066358 0.066358 0.006597 1.011935
XGBClassifier_NONE_BASE_LINE_VALUES POSTPROCESSING ThresholdOptimizer NONE_BASE_LINE_VALUES 0.644491 0.678773 0.683480 0.066358 0.066358 0.006597 1.011935
NEURONAL_NETWORK IN_PROCESSING DISTRACTION DEMV 0.643798 0.672194 0.664565 0.036177 0.036177 -0.020189 0.963335
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER FOS 0.643105 0.673431 0.669609 0.001101 0.028756 -0.042318 0.925982
ExtraTreesClassifier POSTPROCESSING ThresholdOptimizer ExtraTreesClassifier 0.641719 0.677882 0.686003 0.059601 0.059601 -0.007139 0.987420
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM SMOTE 0.641026 0.622999 0.539723 -0.130676 0.163255 -0.176412 0.661461
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD SMOTE 0.641026 0.622999 0.539723 -0.130676 0.163255 -0.176412 0.661461
GradientBoostingClassifier POSTPROCESSING ThresholdOptimizer GradientBoostingClassifier 0.640333 0.676232 0.683480 0.082529 0.082529 0.006505 1.011680
RandomForestClassifier POSTPROCESSING ThresholdOptimizer RandomForestClassifier 0.638947 0.667518 0.659521 0.049690 0.049690 -0.011796 0.978328
DecisionTreeClassifier POSTPROCESSING ThresholdOptimizer DecisionTreeClassifier 0.637561 0.673737 0.680958 0.078505 0.078505 -0.002920 0.994817
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM RUS 0.636175 0.622030 0.544767 -0.133409 0.147686 -0.170357 0.677003
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD RUS 0.636175 0.622030 0.544767 -0.133409 0.147686 -0.170357 0.677003
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER ROS 0.635482 0.637741 0.583859 -0.135720 0.149519 -0.171317 0.700353
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM FOS 0.634789 0.602264 0.503153 -0.156683 0.159208 -0.189279 0.618220
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD FOS 0.634789 0.602264 0.503153 -0.156683 0.159208 -0.189279 0.618220
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER SMOTE 0.631324 0.631579 0.575032 -0.149804 0.151638 -0.179573 0.685913
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER RUS 0.631324 0.631579 0.575032 -0.149804 0.151638 -0.179573 0.685913
AdaBoostClassifier PREPROCESSING FAIR_GAN HYPERPARAMETER 0.616078 0.672577 0.717528 -0.251258 0.251258 -0.262942 0.671149
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_GAN 0.614692 0.690078 0.780580 -0.075188 0.075188 -0.094845 0.874773
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.611227 0.654344 0.669609 -0.090536 0.090536 -0.098523 0.846383
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_GAN 0.611227 0.654344 0.669609 -0.090536 0.090536 -0.098523 0.846383
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.610534 0.685330 0.771753 -0.078491 0.078491 -0.093676 0.875274
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE FAIR_GAN 0.607069 0.686913 0.784363 -0.079932 0.079932 -0.086726 0.886441
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_GAN 0.604297 0.676120 0.751576 -0.072951 0.072951 -0.082853 0.886167
AdaBoostClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.595981 0.491718 0.355612 -0.176478 0.176478 -0.184472 0.500345
AdaBoostClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_SMOTE 0.595981 0.491718 0.355612 -0.176478 0.176478 -0.184472 0.500345
NEURONAL_NETWORK IN_PROCESSING FAIR_FOR_FREE FAIR_SMOTE 0.595981 0.491718 0.355612 -0.176478 0.176478 -0.184472 0.500345
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_GAN 0.592516 0.690200 0.825977 -0.078219 0.078219 -0.072344 0.911163
AdaBoostClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.592516 0.640147 0.659521 -0.343813 0.343813 -0.322798 0.596290
GradientBoostingClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.591823 0.482880 0.346784 -0.158220 0.158220 -0.164452 0.530419
GradientBoostingClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
XGBClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
AdaBoostClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
RandomForestClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
ExtraTreesClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
DecisionTreeClassifier BASE_LINE PCA PCA 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
ExtraTreesClassifier BASE_LINE PCA HYPERPARAMETER 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
AdaBoostClassifier BASE_LINE PCA HYPERPARAMETER 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
GradientBoostingClassifier BASE_LINE PCA HYPERPARAMETER 0.591130 0.690776 0.831021 -0.054000 0.155708 -0.109149 0.870980
XGBClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
RandomForestClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
ExtraTreesClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
DecisionTreeClassifier PREPROCESSING UNAWARENESS UNAWARENESS_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
GradientBoostingClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_SMOTE 0.586972 0.470693 0.334174 -0.172950 0.172950 -0.174727 0.498058
NEURONAL_NETWORK IN_PROCESSING RULER FAIR_GAN 0.581428 0.654857 0.722573 -0.356409 0.470720 -0.413580 0.560455
ExtraTreesClassifier PREPROCESSING FAIR_GAN HYPERPARAMETER 0.575884 0.682243 0.828499 -0.160442 0.237122 -0.200533 0.781989
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM FAIR_GAN 0.570340 0.609079 0.609079 -0.073916 0.073916 -0.070731 0.881532
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD FAIR_GAN 0.570340 0.609079 0.609079 -0.073916 0.073916 -0.070731 0.881532
GradientBoostingClassifier PREPROCESSING FAIR_GAN HYPERPARAMETER 0.566875 0.625075 0.656999 -0.293933 0.404875 -0.348434 0.585030
XGBClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.565489 0.623423 0.654477 -0.287176 0.404875 -0.344215 0.587985
RandomForestClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.562024 0.617433 0.643127 -0.316065 0.421086 -0.367056 0.563949
ExtraTreesClassifier PREPROCESSING UNAWARENESS HYPERPARAMETER_FAIR_SMOTE 0.562024 0.404896 0.271122 -0.128011 0.128011 -0.127673 0.530876
GradientBoostingClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.559252 0.618247 0.649433 -0.241320 0.332389 -0.286632 0.640572
DecisionTreeClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.553708 0.604908 0.621690 -0.210119 0.369787 -0.282942 0.632563
ExtraTreesClassifier PREPROCESSING FAIR_GAN FAIR_GAN 0.550243 0.599630 0.612863 -0.234984 0.381761 -0.301655 0.611455
NEURONAL_NETWORK IN_PROCESSING FairODTrainer SMOTE 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING FairODTrainer BAL_GAN_FAIR 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING FairODTrainer DEMV 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING FairODTrainer FAIR_GAN 0.549550 0.709302 1.000000 0.000000 0.000000 0.000000 1.000000
NEURONAL_NETWORK IN_PROCESSING DISTRACTION FAIR_GAN 0.541234 0.591862 0.605296 -0.295571 0.397877 -0.341465 0.575185
GradientBoostingClassifier BASE_LINE PCA SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
XGBClassifier BASE_LINE PCA SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
AdaBoostClassifier BASE_LINE PCA SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
RandomForestClassifier BASE_LINE PCA SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
ExtraTreesClassifier BASE_LINE PCA SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
DecisionTreeClassifier BASE_LINE PCA SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
ExtraTreesClassifier BASE_LINE PCA HYPERPARAMETER_SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
AdaBoostClassifier BASE_LINE PCA HYPERPARAMETER_SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
GradientBoostingClassifier BASE_LINE PCA HYPERPARAMETER_SMOTE 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
GradientBoostingClassifier BASE_LINE PCA ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
XGBClassifier BASE_LINE PCA ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
AdaBoostClassifier BASE_LINE PCA ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
RandomForestClassifier BASE_LINE PCA ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
ExtraTreesClassifier BASE_LINE PCA ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
DecisionTreeClassifier BASE_LINE PCA ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
ExtraTreesClassifier BASE_LINE PCA HYPERPARAMETER_ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
AdaBoostClassifier BASE_LINE PCA HYPERPARAMETER_ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
GradientBoostingClassifier BASE_LINE PCA HYPERPARAMETER_ROS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
GradientBoostingClassifier BASE_LINE PCA RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
XGBClassifier BASE_LINE PCA RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
AdaBoostClassifier BASE_LINE PCA RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
RandomForestClassifier BASE_LINE PCA RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
ExtraTreesClassifier BASE_LINE PCA RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
DecisionTreeClassifier BASE_LINE PCA RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
ExtraTreesClassifier BASE_LINE PCA HYPERPARAMETER_RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
AdaBoostClassifier BASE_LINE PCA HYPERPARAMETER_RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
GradientBoostingClassifier BASE_LINE PCA HYPERPARAMETER_RUS 0.539848 0.402878 0.282472 -0.142245 0.142245 -0.148332 0.537437
AdaBoostClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539848 0.365201 0.240858 -0.645270 0.645270 -0.533755 0.000000
AdaBoostClassifier PREPROCESSING FAIR_SMOTE HYPERPARAMETER 0.539848 0.365201 0.240858 -0.645270 0.645270 -0.533755 0.000000
XGBClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
RandomForestClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
ExtraTreesClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
DecisionTreeClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.539155 0.375587 0.252207 -0.675676 0.675676 -0.573840 0.000000
NEURONAL_NETWORK IN_PROCESSING RULER FAIR_SMOTE 0.533611 0.334322 0.213115 -0.570946 0.570946 -0.459916 0.000000
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_FGSM FAIR_SMOTE 0.533611 0.323618 0.203026 -0.069559 0.069559 -0.071149 0.621074
NEURONAL_NETWORK IN_PROCESSING ROB_FAIRNESS_PGD FAIR_SMOTE 0.533611 0.323618 0.203026 -0.069559 0.069559 -0.071149 0.621074
ExtraTreesClassifier PREPROCESSING FAIR_SMOTE HYPERPARAMETER 0.532918 0.330020 0.209332 -0.560811 0.560811 -0.449367 0.000000
GradientBoostingClassifier PREPROCESSING FAIR_SMOTE FAIR_SMOTE 0.532225 0.336283 0.215637 -0.577703 0.577703 -0.472574 0.000000
GradientBoostingClassifier PREPROCESSING FAIR_SMOTE HYPERPARAMETER 0.531532 0.338552 0.218159 -0.584459 0.584459 -0.483122 0.000000
NEURONAL_NETWORK IN_PROCESSING DISTRACTION FAIR_SMOTE 0.531532 0.335953 0.215637 -0.577703 0.577703 -0.474684 0.000000
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER FAIR_GAN 0.471240 0.097041 0.051702 -0.138514 0.138514 -0.109705 0.000000
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER FAIR_SMOTE 0.450450 0.000000 0.000000 0.000000 0.000000 0.000000 NaN
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER BAL_GAN_FAIR 0.450450 0.000000 0.000000 0.000000 0.000000 0.000000 NaN
GERRY_FAIR_CLASSIFIER IN_PROCESSING GERRY_FAIR_CLASSIFIER DEMV 0.450450 0.000000 0.000000 0.000000 0.000000 0.000000 NaN
6.5 Proceso de revisión

Luego de tener resultados de evaluación del modelo se pueden establecer un conjunto de acciones para comprender cómo se toman las decisiones. Es recomendable hacer un análisis de importancia de características, para establecer la contribución relativa de cada característica en las predicciones del modelo. Teniendo en cuenta este orden se procede a revisar cual es la característica más importante y la que menos contribuye en la salida del modelo.

Probabilidad de predicción positiva: ¿Qué porcentaje de cada grupo recibe una predicción positiva?

Distribución de la Probabilidad de Predicción Positiva por Grupo Sensible

Varianza de las predicciones dentro de un grupo: ¿Las predicciones dentro de un mismo grupo son consistentes o varían mucho?

Varianza de las Predicciones por Grupo Sensible

Disparidad entre grupos: ¿Hay diferencias significativas en las tasas de predicción positiva?

Comparación de Probabilidad Media de Predicción Positiva por Clasificador Comparación de la Equidad entre las 10 Mejores Combinaciones de Parámetros

Usa LIME para generar explicaciones locales sobre la influencia de las características en las predicciones del modelo.

Importancia de Características según LIME

Usa SHAP para calcular la importancia de cada característica en la toma de decisiones del modelo.

Importancia de Características según SHAP

Se generan múltiples versiones de los datos y se filtran aquellas que producen resultados distintos en un modelo de clasificación.

Se calculan distancias entre las versiones originales y las alteradas, almacenando la información resultante.

Posteriormente, los valores generados se ajustan para mantener coherencia con los datos originales.

Distribución de la Distancia por Cantidad de Cambios Impacto de Cada Atributo en la Distancia Comparación de Distribuciones de Distancia